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METHODS OF OPTEMISmG STOCHASTIC PROCESSING 
PARAJVIETERS m CROP HARVESTmG MACHINES 

This invention relates to methods for establishing parameters for modelling the 
5 behaviour of crop harvesting machines such as but not limited to combine 
harvesters. In particular it relates to a method for optimising stochastic model 
parameters in models for a crop processing operation in such harvesting machines. 

The method is particularly useful in the context of "precision farming" techniques, 
10 in which combine harvesters and other harvesting machines have played a 
significant role, as well for the development as for the application of these 
techniques. . ' 



'Trecision farming" is a broad term that embraces practices such as: 



- field yield mapping aimed at accurately mapping the crop-producing 
productivity of a field so that: 

seeds and agro-chemicals can be economically and correctly applied 
without over- and under-dosing the plants; 
20 • harvesting and other agricultural machinery can be adjusted to take 

account of varying crop conditions from place to place in a field; 

^ modelling, of process conditions, within agricultural machines, and developing 
control philosophies aimed at: 
25 • improving machine efiFiciency or workrate; 

reducing fuel consumption; and 
• improving the quality of work carried out by agricultural machines; 



- providing alerts and reports of abnormal conditions in crops . 

Sometimes the. overall improvement in farming efficiency resulting from an 
individual precision farming practice might be only a few percent, but 
cumulatively such efforts have dramatically improved productivity in mechanised 
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farming over recent years. 

The significance of harvesters, such as combine harvesters, to precision farming 
derives principally from the following factors: 

5 

(i) A harvester is able to assess the output of a farming operation for example in 
terms of crop yield. A field map of such data is invaluable in improving 
farming efficiency in future crop grovwng and harvesting seasons; 

10 (ii) Harvesters are complicated machines that provide numerous sites for the 
location of transducers whose ftmction is to gather data on the harvesting 
processes and the crops passing through the machine. 

As noted, the combine harvester has been particularly useful in producing maps 
15 indicating the expected crop yield at different locations in a field.' Farmers can use 
such maps (that are readily stored in digital form in a computer memory) to 
control in an accurate way the processes forming part of a crop growing season, so 
that the yield of the field is maximised. 

20 Prior art techniques for yield mapping, however, are limited primarily because 
they concentrate on the quantity of the useable part of the crop that is conveyed to 
e.g. the clean grain tank in a combine harvester. 

Although measurements of e.g. the mass flowrate of clean grain to the clean grain 
25 tank may readily be compensated for some variables such as grain moisture 
content and grain type, some difficulties remain. 

Significant among these is the fact that mass flowrate measurements of crop yield 
generally take no account of crop losses arising fi-om e.g. incomplete or faulty 
30 threshing of ears in the threshing drum or another part of the harvester where grain 
sep2Lration occurs. Where the machine load exceeds the threshing, separation 
and/or cleaning capacity of the machine a portion of the harvested grain will not 
be separated from the straw and chaff and be deposited therewith on the field 
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behind the machine. 

It is known, for example, that the extent to which (or the ease with which) ears are 
threshed in the threshing drum of a combine harvester is strongly dependent on the 
5 feedrate of crop into the harvesting machine, when such factors as grain and straw 
moisture, crop variety and straw length are kept as constants. Thus for higher 
feedrates relatively less grain is separated in the first concave threshing drum 
section than in the case of low feedrates. More grain has to be separated in the 
further stages of the harvester. 
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Consequently for such high feedrates a lesser proportion of the crop is therefore 
likely to reach the clean grain tank, with the result that a yield measurement taken 
at such a location may be inaccurate. Furthermore such a measurement takes no 
account of the extent to which grains become damaged or lost within the combine 
15 harvester. 

In reality a great number of variables influences the extent to which the threshing 
and separating sections are able to separate grain from other plant matter such as 
chaff and straw. Such variables include, but are not limited to: 
20 - the nature of the soil in which the crop grows; 

- settings of various adjustable components of the harvesting machine, e.g. the 
height of the header bar in a combine harvester, which directly influences the 
straw to grain ratio; 

- the slope of the field in which the machine operates; 
25 — the moisture content of the crop; 

- the crop type; 

- the forward speed of the harvesting machine; 

- the presence of weed patches; 

- the state (wear) of the machine elements; 

30 - the type of installed machine elements, e.g. the type of rasp bars; 
and so on. 



According to a first aspect of the invention there is provided a method of 




substantially continuously optimising a stochastic parameter S that characterises 
the instantaneously prevailing readiness with which crop is processed in a 
harvesting machine, including the step of recursively calculating the optimised 
parameter value in accordance with the following algorithm: 

5 m = fm'-ixs(tMt'm ■ 

wherein: 

,9(^) is the optimised stochastic parameter value at time t; and 
s(t, 3(t)) is an error prediction function. 

10 Such a method is highly suited to the continuous optimisation of the highly 
stochastic parameter ^ that, when applied to the threshing and separation process 
a combine harvester, may fairly be termed a 'threshability" parameter, i.e. an 
indication of the extent to which the harvesting machine is capable of threshing 
the crop at time t. 

15 

Such a parameter is useable in various ways, as discussed hereinbelow. 
The algorithm generally may take the form of 

20 

The method of the broad aspect of the invention can readily be carried out using a 
suitably programmed computer carried by or forming part of the harvesting 
machine. 

25 Preferably the algorithm (A) has the form : 
wherein 

y{t) is a gain term; 

r(t) is a scalar approximation of a Hessian V"(S) in which Fis indicative 
30 which F is a quadratic error criterion; and 

i^// q) = ^y^^"^) in which yii.S) is an estimation of a value indicative of 
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the effectiveness of said crop processing in said harvesting machine said 
estimation being based on stochastic parameter 3 ; and 

^(^«9(r-l)) is the difference between the actual effectiveness value y(tj 
and the estimated value j>(^i9) based on the previously optimised parameter 

Preferably the algorithm (A) includes an estimation of r{t) that is weighted to 
reduce the influence, on the optimised parameter values 3 , of past measurements. 

10 This aspect of the method renders the parameter optimisation more realistic and 
robust for a wide range of working conditions. 

The parameter 3 may be usable in a model for the relation between a 
value u(tj indicative of the feedrate of crop into the harvesting machine and a 
15 value y(tj indicative of the effectiveness of an operation processing said crop in 
said harvesting machine. The estimated value y{t,&) is then an estimation of the 
effectiveness obtained by the application of said model to the feedrate values u(tj. 

In this manner the model can be updated continuously in order to meet any 
20 changes to the process caused by a wide range of changing conditions, e.g. 
varying crop properties such as ripeness or moisture or changes in inclination of 
the machine. 

Advantageously, the model may comprise an exponential function. Such form 
25 provides some computational advantages for the optimisation of i9 . 

The effectiveness may take the form of a value indicative of crop flow, e.g. crop 
losses at the end of the separation or the cleaning section. It may also comprise 
the crop flow in a return system. 

30 

According to a second aspect of the invention there is provided a method of 
operating a harvesting machine comprising the steps of 
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(i) substantially continuously optimising a stochastic parameter that 
characterises the instantaneously prevailing readiness with which the harvesting 
machine processes crop, 

(ii) substantially continuously adjusting a performance variable of the 
5 harvesting machine in dependence on the instantaneous, optimised value of the 

said parameter in order to optimise the load of the harvesting machine so as to 
keep a value indicative of the effectiveness of said harvesting machine below a 
predetermined value. 

10 Such effectiveness value may comprise the losses of useable crop parts such as 
separation or cleaning sieve losses, or a proportion of damaged useable crop parts, 
e.g. broken grain kernels, or a proportion of unwanted material in the useable crop 
parts, e.g. chaff and straw and particles in the clean grain. 

15 Optimising the machine load may comprise optimising the feedrate of crop into 
the harvesting machine, e.g. by adapting the travel speed of the harvesting 
machine. 

Conveniently the step (ii) of adjusting a performance variable of the harvesting 
20 machine occurs in dependence on the output of an inverted form of a 
effectiveness estimation function: 

y{t, &) = cxp{3u{t)) - 1 -(B) 

25 Herein u(rj may be the measured feedrate and y{t,&) the grain losses. 

According to a third aspect of the invention there is provided a method of 
mapping one or more field lots for variations . in a stochastic parameter that 
characterises the instantaneously prevailing readiness with which a harvesting 
30 machine processes crop, the method comprising the steps of 

(i) operating a harvesting machine to han/est crop in a said field lot; 

(ii) simultaneously measuring the machine load and the machine 
effectiveness and determining the position of the machine in the field lot, 
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(iii) storing data indicative of the position of the harvesting machine at 

timet; 

(iv) using the measured machine load and machine effectiveness data in an 
optimisation of the said parameter; and 

5 (v) mapping the optimised parameter values obtained from step (iv) so as 

to produce a parameter map of the field lot. 

According to a fourth aspect of the invention there is provided a method of 
10 operating a harvesting machine comprising the steps of: 

(i) substantially continuously optimising a stochastic parameter that 
characterises the instantaneously prevailing readiness with which the harvesting 
machine separates useable crop parts fi-om other plant matter; 

(ii) sending a display signal, that is indicative of the instantanieous 
15 parameter value, to a display device. 

Preferably the display signal indicates an abnormal parameter value. 

Preferably in each of the second, third and fourth aspects of the invention the 
20 optimisation step is in accordance with the first aspect of the invention. Thus the 
method of the first aspect of the invention is highly versatile in its application. 

Conveniently in each of the 2""*^ to 4* aspects of the invention, when the parameter 
optiniisation is according to the first aspect of the invention, the said selected part 
25 of the harvesting machine is selected from: 

the separation section, e.g. the straw walkers or a rotary separator; 

the sieve; 

the return flow system, or 
the cleaning section; 
30 the grain elevator; 

of a combine harvester. 

The invention will now be described in more detail, by way of non-limiting 
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example. In the following description reference is made to the accompanying 
drawing figures in which: 

Figure 1 is a schematic representation of the threshing, cleaning and straw 
walker sections of a combine harvester showing the possible locations for grain 
loss transducing devices; 

Figure 2 is a graphical representation of the highly stochastic nature of a 
processability, in particular threshability parameter by reference to field slope 
(gradient) values; 

Figure 3 shows a graphical form the variability of the optimised parameter 
value jfrom place to place in a field undergoing harvesting. The Figure 3 graph 
also includes, for comparison purposes, plots of parameter values calculated 
offline using a Least Squares technique also used to generate the plots of Figure 2; 
and 

Figure 4 is a comparison between a parameter value map and the slope of 
the field to which it relates. 

The terms "grain", "straw", and 'failings" are used principally throughout this 
specification for convenience and it should be understood that these terms are not 
intended to be limiting. Thus "grain" refers to that part of the crop which is 
threshed and separated fi-om the discardable part of the crop material which is 
referred to as "straw". Incompletely threshed ears are referred to as 'failings". 
Also, the terms "forward", "rearward", 'dipper", "lower", "left", "right", etc. 
when used in connection with the combine harvester and/or components thereof, 
are determined with reference to the combine harvester in its normal operational 
condition and may refer either to the direction of forward operative travel of the 
combine harvester or to the direction of normal material flow through components 
thereof These terms should not be construed as limiting. 

Figure 1 shows the position of respective crop flow or loss sensors 10, 11, 12 in 
the separation (13), cleaning (14) and return flow (15) sections of a typical 
combine harvester. The illustrated separation section comprises a set of straw 
walkers 13, but the invention may also be used with harvesters comprising a rotary 
separator. 
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Any of the positions 10, 11, 12 may readily be used within the scope of the 
invention as locations for grain loss sensors. The following notes apply to the 
respective sensors: 
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Sensor 10 

Separation losses are generally measured by means of impact detectors. Impacts 
of kernels are separated from impacts of straw ends and counted each second. By 
this, a measure is found for the amount of separation losses. Since the distribution 
10 of free grain kernels along the depth of the straw layer varies in time, only a rough 
indication is normally obtained. 

Sensor 11 

One similar impact sensor may be installed at the end of the cleaning section. 
15 Again only a rough measure is normally found for the sieve losses. 

Sensor 12 

Taihngs fall behind the lower sieve into the cross auger of the return flow system. 
An impeller is installed at the end of the fast rotating auger to spread the return 
20 flow. The sensor preferably operates measuring the phase shift between a fixed 
impeller and a flexible one as described in EP-A-0 463 240. Higher material 
flows imply larger phiase shifts. 

In addition, the harvester preferably is equipped with precision farming tools to 
25 measure the actual cutting width, ground speed, mass flow, feedrate and position 
within the field. 

The outputs of such sensors may be employed in a technique, involving the use of 
an offline model for the crop processing operation. Establishing such model 
30 involves the determination of one or more parameters, e.g. a threshability 
parameter S . 

The exponential function offers good opportunities to make a prediction y(t,&) of 
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actual separation losses y(t) (T/h) based on an online measurement of feedrate 
u(t) (T/h). The feedrate may be measured at the inlet of the harvester, e.g. by 
monitoring the volume of crop material entering the straw elevator, or by 
measuring the force or torque needed to convey the crop mass into the machine. 

Advantageously, the exponential function may take the form of: 

y{t,&)=exp(Su{t))-.l (1) 

Equation (1) illustrates that no separation losses occurs for a zero feedrate and the 
feedrate-loss relation is fully determined by parameter S. The time delay 
between the feedrate signal u(t) and y(tj is assumed to be fixed and an optimal 
fixed time shift (typically lis) is installed as a compensation. For online 
measurements, separation losses and feedrate will be expressed in respectively 
impacts per second (#/s) and Volt (V). To optimise the parameter & , following 
quadratic critraion V{s) is proposed in fimction of prediction error e{t,S) (#/s): 

V{&)=E{0.5€'{t,S)} s{t,S) = y{t)-y{t,&) (2) 

In case an optimal solution has to be found after N discrete input and output 
measurements (uk. yk> are carried out, V{S) can be approximated by {&) : 

For each set of N measurements it is possible to find an optimal parameter 3 
wherefor the quadratic criterion V{&) is minimised. Figure 2 gives the optimised 
exponential relation for five sections in one 330m harvest strip with a large 
variance in threshability due to different nitrogen appUcations and slope (a) 
fluctuations. In the first and last section, some erratic data points are lying near to 
the X and Y-axis respectively because of the dynamic step responses when the 
harvester entCTS and leaves the crop. 
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Recursive estimation of grain loss curves 
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As can be seen in Figure 2, a large variance in the model parameter can be 
detected in one single crop strip. Therefore, it is preferable to have an online 
optimal estimation (in accordance with the invention) of the local separation 
behaviour. This site-specific information offers new possibilities for automatic 
tuning systems in a more direct way compared to the prior art online yield 
mapping systems, since it immediately relates feedrate u(t) with straw walker 
losses y(t) and provides an extra crop parameter & that may play an important role 
in the evaluation of new crop varieties. 
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Herein an online optiniisation procedure is derived based on a stochastic gradient 
method. The stochastic gradient method can be seen as a stochastic analog of the 
method of steepest descent for the minimisation of a deterministic function. In its 
general form, this method of steepest descent is represented by: 



j^O+l) _^(0 



dx 



(4) 



20 where x^'^ denotes the t th iterate and y^^^ a chosen positive scalar. This approach 
may show useful , however, when the iterates are getting close to the minimum, 
this method is known to be fairly inefficient. 

The so-called quasi-Newton methods yield distinctly better results and use a 
25 modified search direction from the negative gradient direction: 



-V{x) 



dx 



(5) 



This iteration will provide convergence in one step to the minimum of V{x), if 
30 this function is quadratic in x and y^^^ = 0.5 . 
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When applied to the present optimisation problem, the quasi-Newton optimisation 
scheme can be transformed into following gradient scheme, which could be called 
a "stochastic Newton algorithm": 

5 

y{&)^m{s,e{t)) (6) 
3{^)^Kt-'^)^rifPi^^^ (7) 

10 where F" (.) denotes the approximate Hessian, -Q (.) is the gradient ofH(x,e) with 
respect to x and e' indicates that the approximation depends on previous noise 
values = e(t), e(t'l)\ ... When this scheme is applied to the problem definition 
of equation (1) and (2), following algorithm is obtained for the model parameter 

m- 

15 

where wit &) = ^^^^'^^ and scalar r(t) corresponds with the instantaneous 

estimation of Hessian V'\&). When an exponential process model according to 
20 function (1) has been chosen, \{/{t,S) will be equal to exp(6^.M (0)^(0 - 

The accuracy of this approximation of the true Hessian plays a particularly 
important part when the recursive algorithm is operating close to the minimum. 
The natural approximation of this Hessian is to introduce the sample mean value: 

25 

^^(^)=E^^H^'9))»it^/K^•9(^-0)=^(r) (9) 

dS t jt=i 

However, the estimation of r(t) in equation (9) puts as much attention on 
measurements temporally far fi-om / as on more recent measurements. Therefore, 
30 a weighted estimation of r(t) usually yields better results: 
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r(t) = j:/3{t,k)v^' (^,# - 1))+ SitYo 



(10) 



where ro denotes the initial estimation of the Hessian fiinction and weighting 
coefficients fi{t,k) and S{t) should be chosen such that 

±fi(t,k) + S{i)^l , (11) 

A standard way to define the weighting coefficients is given by 

KO-ro ^(0-ri[i-^ol M^*)-fI[l-ro] (12) 

It is easy to verify that this choice of parameters fulfils condition (11). 
gain parameter ro corresponds to an exponential forgetting factor = 1 

A preferred but non-limiting practical realisation of this stochastic Newtoii 
algorithm is shown hereinafter: 

r(0)=ro; 

e(0)=eo; 

k=l; 

while (k<N) ; 

11/ {k)=u (k) *exp[u (k) *e (k-1) ] ; 
e (k)=y(k)-exp[u(k) *e (k-1) ]+l; 
r (k)=r (k-l)+Yo* [v|/^ {k)-r (k-1) ] ; 
e(k)=e{k-l)+Yo*^|/(k)*e{k)/r(k) ; 

k++; 

end; 

The algorithm is computationally cheap and can easily be implemented ir 
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machine software. Three parameters have to be determined before starting the 
algorithm. The preferred but non-Umiting default values that are used in this study 
are added between brackets. 

1. Gain sequence is set at a constant value (0.2). This parameter 
immediately determines the tracking capabilities of the algorithm but has also 
an important influence on the variance on the estimation of parameter «9(A:) . A 
high constant gain brings about fast tracking dynamics to follow fluctuations of 

but introduces large fluctuations around the true i9(/:), even when the 
true parameter does not vary in time. It depends on the appHcation purposes 
and sample frequency whether a high or low gain should be chosen. 

2. The initial estimation To (500) of the Hessian function determines the 
confidence of having an accurate initial estimation of A high value of 
implies a long term effect of the initial estimation on the following 
parameter estimations. 

3. Different strategies can be introduced to choose the initial parameter estimation 
3q (8). The last parameter value of a previous harvest run can be used or a 
parameter estimation of a near by crop strip when the tracking algorithm is 
connected to a positioning system. 

Results and discussion 

The algorithm that has been developed in the previous section can be used to track 
the relation between all combinations of process (e.g. separation) and feedrate 
sensors. Hereabove, the relation between feedrate and straw walker losses has 
been studied in more detail, since it may be used in automatic tuning systems that 
control the straw walker losses by adapting the feedrate. When the static non- 
linear characteristic between both signals can be tracked online, a ground speed 
control system can be realised that keeps the straw walker losses at a predefined 
level. When such knowledge about the instantaneous separation behaviour would 
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not be available, more conservative controllers have to be designed, resulting in 
lower control performances. 

In Figure 2, the signals of one 330 m harvest strip were divided into five distinct 
sections of about 66 m each. For each section, an optimal exponential parameter 
S is calculated based on offline optimisation techniques. Figure 3 shows the 
results of the recursive algorithm for the same harvest strip. The resultis of the 
previously described offline optimisation procedure are also sho'vsm to illustrate the 
performance of the tracking algorithm. Roughly the same parameters are 
obtained, but now in an online, recursive way. The zone between 50 and 150 m 
corresponds to data from an uphill section (+15%). Harvesting uphill reduces the 
separation capacity of conventional harvesters and as a result, larger coefficients 
t9 are obtained. Similar results are found for zones with smaller grain/straw ratios 
or higher moisture contents. 

Site-Specific interpretation of estimated parameter sequence 

In case variations of parameter 9 depend on local field conditions, the same trend 
should be visible in adjacent strips. Figure 4 shows this type of parameter map for 
a set of 7 runs that are harvested uphill, parallel to the Y-axis. The correlation 
with the field, slope or machine slope is evident, illustrating the value of this type 
of parametric maps for on-line tuning of harvesters, before variations in local 
processability are actually registered. This field was fertilised with different doses 
of Nitrogen in strips parallel to the Y-axis. . Therefore, the harvester reacts in a 
slightly different way according to the Nitrogen gift and by this, to its position on 
the X-axis. A field with a constant Nitrogen application would give an even better 
correlation of the parameter and slope map. 

Although in the foregoing discussion the relationship between feedrate u(t) and 
straw walker losses y(t) is described, the method of the invention could equally 
well be used for optimising parameters 9 in models for other crop handlmg 
processes at any of the following sections of a combine harvester: 

the separation section, e.g. the straw walker or the separator rotor; 
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the sieves; 

the return flow system; or 
the cleaning section; 
or indeed in sections of other kinds of harvester. 

5 

A processability parameter can also be used for predicting the behaviour of the 
harvesting machine with respect to other effectiveness values such as the 
proportion of damaged useable crop parts, e.g. broken grain kernels, or a 
proportion of unwanted material in the useable crop parts, e.g. chaff and straw and 
10 particles in the clean grain. 

The ability of the method of the invention to optimise the parameter 3 in an 
online way offers numerous potential advantages, such as: 

the ability to devise a reliable vehicle control system that controls a 
15 performance variable of the harvesting machine and that relies on a feedrate set 
point calculated by an inverted form of Equation (1); 

the ability to devise processability -based expert systems, e.g. diagnostic 
systems that are self-executing in a combine harvester; warning systems 
manifested as feedrate or parameter "out of range" values; or information systems 
20 such as gradient-related data about likely crop losses. 

A fiirther advantage of the methods of the invention is that the processability 
parameter i9 can if desired be assessed largely independently of the various 
sensing subsystems of a harvesting machine equipped for precision farming.. In 
25 other words the optimised threshability parameter S implicitly takes account of 
the crop, vehicle and field conditions that give rise to a particular value of & , 
without necessarily having to evaluate each individual cause. 

The method described in full detail above can be used for optimising a single 
30 parameter used in a model for crop processing. However, it is readily conceivable 
that analogous methods can be used for optimising two or more stochastic 
parameters where such plurality of parameters is used for modelling an operation 
in a harvesting machine. Each parameter by itself, or each combination of 
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parameters, can constitute a characteristic of the readiness with which the crop is 
processed. 
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